onboard sensor
Local Path Planning with Dynamic Obstacle Avoidance in Unstructured Environments
Guvenkaya, Okan Arif, Iz, Selim Ahmet, Unel, Mustafa
Obstacle avoidance and path planning are essential for guiding unmanned ground vehicles (UGVs) through environments that are densely populated with dynamic obstacles. This paper develops a novel approach that combines tangentbased path planning and extrapolation methods to create a new decision-making algorithm for local path planning. In the assumed scenario, a UGV has a prior knowledge of its initial and target points within the dynamic environment. A global path has already been computed, and the robot is provided with waypoints along this path. As the UGV travels between these waypoints, the algorithm aims to avoid collisions with dynamic obstacles. These obstacles follow polynomial trajectories, with their initial positions randomized in the local map and velocities randomized between O and the allowable physical velocity limit of the robot, along with some random accelerations. The developed algorithm is tested in several scenarios where many dynamic obstacles move randomly in the environment. Simulation results show the effectiveness of the proposed local path planning strategy by gradually generating a collision free path which allows the robot to navigate safely between initial and the target locations.
Wireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Survey
Song, Zhiying, Xie, Tenghui, Wen, Fuxi, Li, Jun
Wireless Communication as an Information Sensor for Multi-agent Cooperative Perception: A Survey Zhiying Song, Tenghui Xie, Fuxi Wen, Senior Member, IEEE, Jun Li Abstract --Cooperative perception extends the perception capabilities of autonomous vehicles by enabling multi-agent information sharing via V ehicle-to-Everything (V2X) communication. Unlike traditional onboard sensors, V2X acts as a dynamic "information sensor" characterized by limited communication, heterogeneity, mobility, and scalability. This survey provides a comprehensive review of recent advancements from the perspective of information-centric cooperative perception, focusing on three key dimensions: information representation, information fusion, and large-scale deployment. We categorize information representation into data-level, feature-level, and object-level schemes, and highlight emerging methods for reducing data volume and compressing messages under communication constraints. In information fusion, we explore techniques under both ideal and non-ideal conditions, including those addressing heterogeneity, localization errors, latency, and packet loss. Finally, we summarize system-level approaches to support scalability in dense traffic scenarios. Compared with existing surveys, this paper introduces a new perspective by treating V2X communication as an information sensor and emphasizing the challenges of deploying cooperative perception in real-world intelligent transportation systems. I NTRODUCTION Autonomous vehicles rely on perception systems to navigate complex scenarios. These systems typically integrate multiple onboard sensors, such as LiDAR and cameras. However, single-vehicle perception has inherent limitations, such as sensor range constraints and occlusion, which fragment the operational design domain and compromise safety [1].
FSMP: A Frontier-Sampling-Mixed Planner for Fast Autonomous Exploration of Complex and Large 3-D Environments
Zhang, Shiyong, Zhang, Xuebo, Dong, Qianli, Wang, Ziyu, Xi, Haobo, Yuan, Jing
In this paper, we propose a systematic framework for fast exploration of complex and large 3-D environments using micro aerial vehicles (MAVs). The key insight is the organic integration of the frontier-based and sampling-based strategies that can achieve rapid global exploration of the environment. Specifically, a field-of-view-based (FOV) frontier detector with the guarantee of completeness and soundness is devised for identifying 3-D map frontiers. Different from random sampling-based methods, the deterministic sampling technique is employed to build and maintain an incremental road map based on the recorded sensor FOVs and newly detected frontiers. With the resulting road map, we propose a two-stage path planner. First, it quickly computes the global optimal exploration path on the road map using the lazy evaluation strategy. Then, the best exploration path is smoothed for further improving the exploration efficiency. We validate the proposed method both in simulation and real-world experiments. The comparative results demonstrate the promising performance of our planner in terms of exploration efficiency, computational time, and explored volume.
Towards UAV-USV Collaboration in Harsh Maritime Conditions Including Large Waves
Novรกk, Filip, Bรกฤa, Tomรกลก, Prochรกzka, Ondลej, Saska, Martin
This paper introduces a system designed for tight collaboration between Unmanned Aerial Vehicles (UAVs) and Unmanned Surface Vehicles (USVs) in harsh maritime conditions characterized by large waves. This onboard UAV system aims to enhance collaboration with USVs for following and landing tasks under such challenging conditions. The main contribution of our system is the novel mathematical USV model, describing the movement of the USV in 6 degrees of freedom on a wavy water surface, which is used to estimate and predict USV states. The estimator fuses data from multiple global and onboard sensors, ensuring accurate USV state estimation. The predictor computes future USV states using the novel mathematical USV model and the last estimated states. The estimated and predicted USV states are forwarded into a trajectory planner that generates a UAV trajectory for following the USV or landing on its deck, even in harsh environmental conditions. The proposed approach was verified in numerous simulations and deployed to the real world, where the UAV was able to follow the USV and land on its deck repeatedly.
Visibility-Aware RRT* for Safety-Critical Navigation of Perception-Limited Robots in Unknown Environments
Kim, Taekyung, Panagou, Dimitra
Safe autonomous navigation in unknown environments remains a critical challenge for robots with limited sensing capabilities. While safety-critical control techniques, such as Control Barrier Functions (CBFs), have been proposed to ensure safety, their effectiveness relies on the assumption that the robot has complete knowledge of its surroundings. In reality, robots often operate with restricted field-of-view and finite sensing range, which can lead to collisions with unknown obstacles if the planning algorithm is agnostic to these limitations. To address this issue, we introduce the visibility-aware RRT* algorithm that combines sampling-based planning with CBFs to generate safe and efficient global reference paths in partially unknown environments. The algorithm incorporates a collision avoidance CBF and a novel visibility CBF, which guarantees that the robot remains within locally collision-free regions, enabling timely detection and avoidance of unknown obstacles. We conduct extensive experiments interfacing the path planners with two different safety-critical controllers, wherein our method outperforms all other compared baselines across both safety and efficiency aspects.
Complementing Onboard Sensors with Satellite Map: A New Perspective for HD Map Construction
Gao, Wenjie, Fu, Jiawei, Shen, Yanqing, Jing, Haodong, Chen, Shitao, Zheng, Nanning
High-definition (HD) maps play a crucial role in autonomous driving systems. Recent methods have attempted to construct HD maps in real-time using vehicle onboard sensors. Due to the inherent limitations of onboard sensors, which include sensitivity to detection range and susceptibility to occlusion by nearby vehicles, the performance of these methods significantly declines in complex scenarios and long-range detection tasks. In this paper, we explore a new perspective that boosts HD map construction through the use of satellite maps to complement onboard sensors. We initially generate the satellite map tiles for each sample in nuScenes and release a complementary dataset for further research. To enable better integration of satellite maps with existing methods, we propose a hierarchical fusion module, which includes feature-level fusion and BEV-level fusion. The feature-level fusion, composed of a mask generator and a masked cross-attention mechanism, is used to refine the features from onboard sensors. The BEV-level fusion mitigates the coordinate differences between features obtained from onboard sensors and satellite maps through an alignment module. The experimental results on the augmented nuScenes showcase the seamless integration of our module into three existing HD map construction methods. The satellite maps and our proposed module notably enhance their performance in both HD map semantic segmentation and instance detection tasks.
Multimodal Dataset from Harsh Sub-Terranean Environment with Aerosol Particles for Frontier Exploration
Kyuroson, Alexander, Dahlquist, Niklas, Stathoulopoulos, Nikolaos, Viswanathan, Vignesh Kottayam, Koval, Anton, Nikolakopoulos, George
Algorithms for autonomous navigation in environments without Global Navigation Satellite System (GNSS) coverage mainly rely on onboard perception systems. These systems commonly incorporate sensors like cameras and Light Detection and Rangings (LiDARs), the performance of which may degrade in the presence of aerosol particles. Thus, there is a need of fusing acquired data from these sensors with data from Radio Detection and Rangings (RADARs) which can penetrate through such particles. Overall, this will improve the performance of localization and collision avoidance algorithms under such environmental conditions. This paper introduces a multimodal dataset from the harsh and unstructured underground environment with aerosol particles. A detailed description of the onboard sensors and the environment, where the dataset is collected are presented to enable full evaluation of acquired data. Furthermore, the dataset contains synchronized raw data measurements from all onboard sensors in Robot Operating System (ROS) format to facilitate the evaluation of navigation, and localization algorithms in such environments. In contrast to the existing datasets, the focus of this paper is not only to capture both temporal and spatial data diversities but also to present the impact of harsh conditions on captured data. Therefore, to validate the dataset, a preliminary comparison of odometry from onboard LiDARs is presented.
A1 SLAM: Quadruped SLAM using the A1's Onboard Sensors
Quadrupeds are highly versatile robots that can traverse over difficult terrain that wheeled mobile robots are unable to. This flexibility makes quadrupeds appealing for various applications, such as inspection, surveying construction sites, and search-and-rescue. However, to effectively perform these tasks autonomously, quadrupeds, as with other mobile robots, require a form of perception that will enable them to localize when placed in an environment without a priori knowledge. For robots to know its location in the environment, it must localize against a predefined map, but a robot can only create a map based on its known location. To solve this chicken-and-egg problem, simultaneous localization and mapping, or SLAM, is the standard approach used for mobile robots by optimizing for the robot's location and map simultaneously. The estimated poses and map from SLAM algorithms can then be used for downstream tasks such as facilitating controllers depending on the terrain or planning in navigation. Despite the recent developments in both quadruped robotics and in SLAM research, there has yet to be an open-source package that is specifically designed for high performing SLAM on quadrupeds.
Providing real-time mapping for autonomous vehicles
Originally posted on The Horizons Tracker. Autonomous vehicles are becoming ever more capable, and if they are to be successful, and safe, when operating on our roads, they need extremely effective vehicle-to-vehicle communication. Researchers from New York University have partnered with HERE HD Live Map to ensure vehicles have accurate information on the status of lanes, obstacles, hazards and speed-limits in real time. The team are developing a deep learning based system that allows autonomous vehicles to navigate and respond to changing road conditions by pairing the data they're collecting from onboard sensors with that from the Here HD live maps. The kind of maps used by autonomous vehicles are accurate to within 10-20cm, and there is a strong requirement for these maps to be updated in real-time to ensure their accuracy.
Video Friday: Rocket RoboBee, Willow Garage, and Caltech's Cassie
Video Friday is your weekly selection of awesome robotics videos, collected by your Automaton bloggers. We'll also be posting a weekly calendar of upcoming robotics events for the next two months; here's what we have so far (send us your events!): Let us know if you have suggestions for next week, and enjoy today's videos. A new RoboBee from Harvard can swim underwater, and then launch itself into the air with a microrocket and fly away. At the millimeter scale, the water's surface might as well be a brick wall.